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Abstract — Given positive integers n and d, let Aa(n, d) denote the max- 
imum size of a binary code of length n and minimum distance d. The well- 
known Gilbert-Varshamov bound asserts that A2(n, d) ^ 2" /V(n, d—1), 
where V{n,d) = ^,t=o (?) ' s * ne volume of a Hamming sphere of radius d. 
We show that, in fact, there exists a positive constant c such that 
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A2(n,d) ^ c 



V(n,d-l) 



log 2 V(n,d-l) 



whenever d/n ^ 0.499. The result follows by recasting the Gilbert-Var- 
shamov bound into a graph-theoretic framework and using the fact that 
the corresponding graph is locally sparse. Generalizations and extensions 
of this result are briefly discussed. 

Keywords — Ajtai-Komlos-Szemeredi bound, asymptotic constructions, 
binary codes, constant-weight codes, Gilbert-Varshamov bound, locally 
sparse graphs, nonlinear codes, g-ary codes. 



I. Introduction 

Let A q (n, d) denote the maximum number of codewords in 
a code of length n and minimum distance d over an alphabet 
with q letters. The Gilbert- Varshamov bound, which asserts that 



A q (n,d) 



Eto (?)(<?- i) i 



(i) 



is one of the most well-known and fundamental results in cod- 
ing theory. In this paper, we focus on binary codes (although 
an extension of our results to codes over an arbitrary alphabet is 
discussed in Section V). Thus we let 



V(n,d) 



del' 



E 

i=0 



denote the volume of a Hamming sphere of radius d in F 2 ", 
and consider the binary version of Q, namely 



A 2 (n, d) ^ fcv{n,d) 



def 



2" 



V(n,d-1) 



(2) 



This inequality was first proved by Gilbert [ 18 1 in 1952. It was 
subsequently improved upon by Varshamov [42 1. However, fol- 
lowing the established terminology, we will refer to Q and (0 
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as the Gilbert-Varshamov bound. This bound is used extensively 
in the coding theory literature 1311 . 1371 . and has been general- 
ized to numerous contexts (9), (29), EO), 1521. 1551. 

Improving upon the Gilbert-Varshamov bound asymptotically 
is a notoriously difficult task 1 37 1 , 1 39 1 . The breakthrough work 
of Tsfasman-VladuJ-Zink |40) led to an asymptotic improve- 
ment of 0, but only for alphabets of size q ^ 49 (see also the 
recent papers 1 16|, |45|). For q < 46, no asymptotic improve- 
ments upon are currently known |48|. In fact, a well-known 
conjecture (cf. Goppa [ 19 1) asserts that the binary version of 
the Gilbert-Varshamov bound is asymptotically exact. 

Nevertheless, for small n and d, the size of best known bi- 
nary codes 1371 Chapter 5] often exceeds /gv("> d) by a large 
factor. Thus it is natural to ask whether the bound can be 
strengthened. Indeed, various improvements upon the binary 
Gilbert-Varshamov bound were presented (in chronological or- 
der) by Varshamov 1 42 1 , Hashim 1 2 1 1 , Elia 1 1 5 1 , Tolhuizen 1 3 8 1 , 
Barg-Guritman-Simonis |5|, and Fabris 1171 . We review these 
improvements in detail in the next section. One of our main 
results herein is the following theorem, which strengthens the 
Gilbert-Varshamov bound using a technique quite different from 
those of 0, 03), OH, ED, Gil, and 1421 . 

Theorem 1. For iel, let \x\ + denote the smallest nonnega- 
tive integer m with m ^ x. Given positive integers n and d, 
with d ^ n, let e(n, d) denote the following quantity 



6 Z — '\W J ^— f * — ' \JJ\i—J 



w \ / n—w 



Then 



A 2 (n,d) ^ 



2™ 



\og 2 V(n,d-l) - log 2 y/e(n,d-l) 



V(n,d-1) 



10 



(3) 



What distinguishes Theorem^ from prior improvements of 
the Gilbert-Varshamov bound is the asymptotic behavior of l|5}. 
All the previously known explicit lower bounds on A 2 (n, d) that 
we are aware of, including those of 0, O), El, ED, |38|, 
and 1 42 1, have the following property: if we write the bound as 
A 2 (n, d) ^ f(n, d), then 



f(n,d) = 0(/ GV (n,d) 



(4) 



In fact, as we shall see in the next section, for some of these 
bounds f(n,d) = fQy(n,d) (l + o(l)), where o(l) tends to 
zero exponentially fast with n. In contrast, the asymptotic be- 
havior of GJ is given by the following theorem. 
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Theorem 2. Let n and d be positive integers, with d/n ^ 0.499. 
Then there exists a positive constant c such that 



A 2 (n,d) Ss 



2" 



V(n,d-1) 



\og 2 V(n,d-l) 



(5) 



Remark. The constant in Theorem|2] the way it is stated above, 
may depend on the ratio d/n. However, if we only wish to claim 
that (|5} is true for all sufficiently large n, then c becomes an 
absolute constant, independent of both n and d. For more on 
this, see ( 138b . Also note that while the bound in (0 holds for 
any n and d with d/n ^ 0.499, it is useful only when the ratio 
d/n is constant. If we allow d/n — + as n — > oo, then better 
bounds on A 2 (n, d) are known 0, ED, <39l . 

So, how does Theorem|2]relate to the conjecture that the Gil- 
bert- Varshamov bound is asymptotically exact for q — 2? This 
depends on the interpretation. If one views the conjecture as 
dealing with the asymptotics of A 2 (n, d) itself, namely the size 
of the best binary codes, then it corresponds to the assertion that 
for all positive 5 < 0.5, we have 



j. A 2 (n,Sn) 
n ^°° fGv(n,8n) 



const 



(6) 



where the constant might be a function of 6. Theorem|2]clearly 
shows that this is false: the limit lim^oo A 2 (n, Sn) //gv(^j $ n ) 
does not exist for any i5. Indeed, the theorem implies that 

log 2 A 2 (n, d) ^ log 2 f GV (n,d) + log(n) + const + o(l) 

(7) 

On the other hand, it is more common to interpret the conjec- 
ture as dealing with the asymptotics of the best possible rate of 
a binary code, namely the function R(n, d) = log 2 A 2 (n, d)/n. 
In this case, the conjecture could still be true, since the term 
log(n) /n will vanish for n — > oo. 

The rest of this paper is organized as follows. In the next 
section, we review the previously known improvements of the 
Gilbert- Varshamov bound, with the aim of establishing @. 
In Section EH, we recast the problem of estimating A 2 (n, d) into 
a graph-theoretic framework, and express A 2 (n, d) as the inde- 
pendence number of a certain graph (LemmaO. We then re- 
cover the Gilbert- Varshamov bound as a straightforward con- 
sequence of a simple bound on the independence number of 
a graph (Proposition^. The key idea in the proof of Theorems 
0and|2]is surprisingly simple: the bound on the independence 
number used in Proposition|4]can be improved upon, providing 
the graph at hand is locally sparse (Theorem^. In Section IV, 
we show that this is, indeed, the case. Specifically, we derive 
a simple closed-form expression for the number of edges in the 
relevant graph (Proposition^, and then prove that this graph 
is sparse for all sufficiently large n whenever d/n ^ 0.4994 
(Proposition ll2t . This completes the proof of Theorems0and[2] 
In Section V, we briefly discuss various extensions and general- 
izations of our results. In particular, we show that just like the 
bounds of Gilbert 1 18 1 and Varshamov |42|, our bound can be 
proved "constructively." That is, there is an (exponential-time) 
algorithm |22| that actually constructs codes satisfying (|5j. We 
also generalize Theorem0to arbitrary alphabets (Theore m! 14l > 



and to constant-weight codes. Finally, we point out a number of 
intriguing open problems related to the results of this paper. 



II. Comparison with Prior Work 

In this section, we briefly review previously known (to us) im- 
provements of the Gilbert- Varshamov bound (|2ji, roughly in 
chronological order, and establish the claim of @. 

The first improvement on (|2ji is due to Varshamov himself. 
Varshamov showed in |42| that A 2 (n, d) ^ fy(n, d), where 1 



/v(n, d) 



del' 



2 [log 2 V>-l,d-2)J 



(8) 



and, moreover, there exist linear codes that attain this bound. We 
now show that the ratio fv(n, d)/ /gv(i, d) is upper bounded 
by a constant. Indeed, we have 



fv(n,d) 



V(n,d-1) 



f GV (n,d) ^ V(n-l,d-2) 



1 



V(n-l,d-l) 
V(n-l,d-2) 



where the equality above follows from the fact that V(n, d—l) = 
V(n—1, d—1) + V(n—1, d—2). Expressing V(n, d) as the sum 
Z~2i=o CO > we further obtain 



V(n-l,d-l) 
V(n-l,d-2) 



= 1 



= 1 



^ 1 



(ri) 



V(n-l,d-2) 
1 

(rf-1)! (n-d)T 
2^i=0 i\ (ra-i— 1)! 

n - (d-1) 
d-l 



(9) 
(10) 

(11) 



where the inequality in ( II Q follows by retaining a single term 
in the sum of (llOi . namely the term corresponding to i = d—2. 
Thus f v (n,d)/f GV (n,d) < (5 + l)/5, where S = (d-l)/n. 

Another improvement of 10 was proposed by Hashim in 1 97 8 . 
Hashim (21] eq.(7)] proved the following. Let t = f(d-l)/2] 
and let A(w; n,k,d) denote the minimum number of codewords 
of weight w in an (n, k, d) binary linear code. Then [21 1 shows 
that A 2 (n, d) ^ 2 k , where k is the largest integer satisfying 



F(,-l,d')-£ E (I) 

w—d i—w — d 1 



A{w;n,k,d) < 2 r ' 



(12) 



where d 1 — d — 2. Unfortunately, the bound d!2t is non-explicit. 
Hashim H21 1 writes that "this improved bound requires the de- 
termination of the lowest possible value of A(w; n, k, d), where 
w = d, d+1, . . . , d—2+t, in terms of the code parameters n, k, 
and d." While various estimates of A(w; n, k, d) are known |4|, 
[23 1, 1 25 1, [26 1, we are not aware of any results that can be used 
in conjunction with dl2> to produce an explicit lower bound on 
A 2 (n, d), at least not without a substantial research effort. 

In 1983, Elia [ 15 1 has extended the Varshamov bound l|8} in 
a different way. Specifically, it is shown in 1151 Corollary 2] that 
A 2 (n, d) ^ /e(^) d), where 

1 Usually, fy(n, d) is denned as 2 k , where k is the largest integer satisfying 
2 k < 2 n /V(n— 1, d—2). The explicit form |SJ is equivalent to this definition. 
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h(n,d) 



clef 



2Llog 2 V(ii-3,d-2)J 2Li°g2 v '("- 2 < d - 3 )J 



It is not difficult to see that, again, the ratio /e(?i, d)/ fevin, d) 
is upper bounded by a constant. Indeed, writing 2 L log 2 y ( n > d ) J as 
V(n, d) /2^°^ v( - n ' d ^ , where {a;} denotes the fractional part of 
x £ K, we have 



2ri-22{log 2 V(ri-3,r;-2)} 

/ E (n, d) < — : — z ~ € 



) n — 1 



V(n-3,d-2) " V(n-3,d-2) 
This, in turn, leads to the following bound 

h(n,d) V{n,d-1) ^ 8V(n-3,d-l) 



f G v(n,d) 2V(n— 3, d— 2) 2V(n-3,d-2) 



(13) 



We know from O that V(n-3, d-l)/V(n-3, d-2) < 1/5, 
where <5 = (d—l)/n. In conjunction with (II 31 . this implies that 
h(n,d)/f GV (n,d) <4/J. 

Tolhuizen [ 38 1 established yet another slight improvement of 
(13 using Turan's theorem |41 Chapter4]. Specifically, Tol- 
huizen 1 38 p. 1605] shows that j4 2 (n, d) ^ /t(«-, d) + 1, where 
/t(«, d) is the largest integer satisfying 



2" 



Mn,d) 



r(f T (n,d) - r) 
2»/ T (n,d) 



> V(n,d-1) (14) 



with r being the remainder when 2" is divided by /t(«, d). If 
we ignore the second term on the left-hand side of HAl . then this 
is precisely the Gilbert- Varshamov bound 0. Otherwise, it is 
easy to see that 

on 

h(n,d) < 



V(n,d-1) - 2-("+ 2 ) 
2 n 2 n ~'~^ 



V(M-l) 2™+ 2 



j = /cvKd) (1 + 0(1)) 



The latest improvement on is due to Fabris 1 17 1. In fact, 
Fabris 1 17 1 proves two new bounds on A%(n, d). The first bound 
is given by ^(n, d) / El (n, d), where 



/fi (n, d) 



drf 2" - J(n,ri-1) 
V(n,d-1) -l(n,d-l) 



(15) 



and 2~(n, d—w) is the volume of the intersection between two 
Hamming spheres of radius d — w, whose centers are distance d 
apart. The second bound is ^(n, d) /f 2 (n, d), where 



/f 2 (n, d) 



def 



7(n,d-l) 



7(Tt, d-l)+T(n, d-2) 
V(n,d-2) 



(16) 



Obviously T(n, d— 2) V^(n,d— 2). Thus it follows straight- 
forwardly from (O, ([Till that /p 2 (n, d)/f G y(n, d) (6+1)/ 8. 
It is not difficult to see (cf. Lemma[8} that 



d—w 



T(n, d — w) 



E E 

i — W A r T£+l 

J—\ 2 



n — w 
i-j 



In Section IV herein, we will show (in a different context) that 
lim n ^oo I(n, d—1) /V(n, d—1) = 0. In conjunction with (1151 . 
this immediately implies that fp 1 (n, d) — fGvi n ,d)(l + o(l)). 



Finally, the recent work of Barg, Guritman and Simonis |5| 
contains various extensions and generalizations of the Var- 
shamov bound (jSJi as well as related prior work by Hashim 1211 . 
Elia 1 15 1, and Edel 1141 . However, just as the Hashim bound, 
most of the results of 1 5 1 are non-explicit — they provide meth- 
ods for constructing codes, but a substantial research effort 
would be required to convert them into an explicit lower bound 
on A2(n,d). On the other hand, |5| does contain the follow- 
ing generalization of Elia's bound: for all fo = 0, 1, ... , d—1, if 
2 b - 1 V(n-b,d-b-l) < 2 n ~ fc and there exists an (n-b,k-l,d) 
code, then A^n, d) ^ 2 fc . If we use the Varshamov bound (|8j 
to guarantee the existence of the (n—b, k—1, d) code, then this 
reduces to ^(n, d) ^ fBGs( n , d), where 



fBos(n,d) 



def 



2" 



^2l l °S2V(n-b-l,d-2)i 2L lo g2^(™-M-b-l)J j 



2" max 



with b serving as an optimization parameter (note that for 6=1, 
we recover the Varshamov bound (|8}, while for b = 2 this is pre- 
cisely the Elia bound). Proceeding as in il It and (1131 while tak- 
ing into account that V(n, d-1) < 2 b+1 V(n-b-l, d-1), it is 
easy to see that /bgs(«, d)/f G v(n, d) < 4/5. 



III. Gilbert- Varshamov Bound 
and Locally Sparse Graphs 

We first recall some elementary terminology from graph theory. 
A graph G consists of a set of vertices V(G) and a set E(G) of 
pairs of vertices, whose elements are called edges. We hence- 
forth assume that both V(G) and E(G) are finite sets. We use 
n(G) and e(G) to denote, respectively, the number of vertices 
and the number of edges in G. Two vertices !i,d£ V(G) are ad- 
jacent or neighbors in G iff {u, v} £ E(G). The set of all neigh- 
bors of a vertex v is denoted N(v) and called the neighborhood 
of v. The degree of a vertex v £ V(G), denoted deg(w), is de- 
fined as deg(w) = |iV(w)|. A graph G is said to be A-regular if 
deg(u) = A for all v £ V(G). A set K C V(G) is a clique if 
every vertex in K is adjacent to all other vertices in K. A clique 
consisting of 3 vertices is a triangle. A set T C V(G) such that 
no two vertices in 1 are adjacent is an independent set. A proper 
c-coloring of G is a partition of V(G) into c independent sets. 
The maximum number of vertices in an independent set is called 
the independence number of G, and denoted a(G). 

The n-dimensional hypercube Ti n is defined as a graph whose 
vertex set V(H n ) is the set of all binary vectors of length n, with 
U, v £ V(7i n ) being adjacent iff d(u, v) = 1, where d(-, ■) is the 
Hamming distance. Note that the graph distance in TL n is equal 
to the Hamming distance. Given a minimum distance d, we de- 
fine the Gilbert graph as Ti n to the power (d — 1). 

Definition. Letn and d ^ n be positive integers. The corresp- 
onding Gilbert graph Qg is defined as follows: V(Gg) — ^2 
and {u, v} £ E(Q G ) if and only if 1 ^ d(u, v) ^ d — 1. 

Clearly, a binary code of length n and minimum distance d 
is an independent set in the Gilbert graph Qg- Conversely, any 
independent set in Qg is a binary code of length n and minimum 
distance at least d. This proves the following. 
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Lemma 3. 



A 2 (n,d) = a{G G ) 



(17) 



Lemma|3]makes it possible to recover the Gilbert- Varshamov 
bound (|2j as a straightforward corollary to a simple bound on 
the independence number of a graph. Since numerous distinct 
proofs of the GV bound (e.g. using Turan's theorem |5|, |38|) 
abound in the literature, it is somewhat surprising that the simple 
proof below seems to have not been previously published. 



Proposition 4. 



a(G G ) ^ 



2" 



V(n,d-1) 



(18) 



Proof. By definition, the Gilbert graph Q G is A-regular with 
A = V(n,d— 1) — 1. Let 2 be a maximal independent set in Qq, 
and let £ C E(Gg) be the set of edges with one endpoint in X 
and the other in V{Q G ) — X. Since X is an independet set, we 
have \E\ — A|X|. Since X is maximal, every vertex of V(Q G )— X 
is adjacent to at least one vertex of X, and so \£\ ^ n(Q G ) — \X\. 
Therefore a (Q G ) > \X\ > n(0 Q )/(A+l) = 2 n /V(n, d-1). | 

Remark. The trivial bound a(Q G ) n(Q G ) / (A+l) proved in 
Proposition|3]is well known in graph theory. This bound can be 
strengthened somewhat using Brooks' theorem |8|, [41 p. 20]: 
since Q G is obviously neither a complete graph nor an odd cycle, 
it must be A-colorable. The largest color class in a proper A-co- 
loring of Q G has to contain at least n(Q G )/ A vertices. 

Note that the proof of Jl 8i requires very little information 
about Q G . Thus we can easily improve upon dl 81 using the fact 
that the neighborhood N(v) of every vertex v in Q G is fairly 
sparse. First, we need a couple of well-known results about lo- 
cally sparse graphs. We say that G is a graph with maximum 
degree at most A if deg(u) ^ A for all v G V(G). 

Lemma 5. Let G be a graph with maximum degree at most A, 
and suppose that there are no triangles in G. Then 



a{G) > 



n(G) 
8A 



log 2 A 



(19) 



Lemma[5] was first proved by Ajtai, Komlos, and Szemere- 
di ID (but see (3 p. 272] for a much shorter proof of the same 
result). Subsequently, the bound in d!9i has been extended from 
graphs without triangles to graphs with relatively few triangles. 
In particular, a proof of the following lemma can be found, for 
example, in Bollobas |7 Lemma 15, p. 296]. 

Lemma 6. Let G be a graph with maximum degree at most A 
and suppose that G contains no more than T triangles. Then 



n(G) 
10A 



log 2 A 



T ' 



Observe that a graph has no triangles iff the neighborhood of 
every vertex is an independent set. If the neighborhood of every 
vertex is sparse, then the graph will have few triangles. This 
simple observation is made precise in the following theorem. 

Theorem 7. Let G be a graph with maximum degree at most A, 
and suppose that for all v G V{G), the subgraph of G induced 
by the neighborhood of v has at most t edges. Then 

^(iog 2 A- y 2 i og2 Q 



a(G) ^ 



Proof. The number of triangles containing a given vertex 
v G V(G) is equal to the number of edges in the subgraph of G 
induced by N(v). Thus, for every v E V(G), there are at most 
t triangles containing v. Summing the number of triangles con- 
taining v over all v G V(G), we count each triangle in G exactly 
three times. Hence, the total number of triangles in G is at most 
n(G) t/3. The theorem now follows from Lemma|5] | 

Thus if we can show that Q G is locally sparse (that is, it sat- 
isfies the conditions of TheoremQ for a relatively small value 
of t), then we can improve upon the Gilbert- Varshamov bound 
of Proposition|4]by a factor of about \og 2 V(n, d— 1) / 10. 



IV. How Sparse Is the Sphere Graph? 

In this section, we consider the Hamming sphere graph Qs, 
which is the subgraph of the Gilbert graph Q G induced by the 
neighborhood -/V(O) of the vertex E V(Q G ). Clearly, the sub- 
graph induced in the Gilbert graph by the neighborhood N(v) 
of any other vertex v E V(Q G ) is isomorphic to Qs- Our goal 
here is to determine how sparse Qs is. Namely, we would like 
to compute e(Qs), the number of edges in Qs, and then deter- 
mine the asymptotic relationship between e(Qs) and the num- 
ber of vertices in Qs- In view of Lemma[3]and Theorem^ this 
would then provide a lower bound on A^n, d) = a(Q G ). 

For convenience, let us write d! = d — 1. Recall that + 
denotes the smallest nonnegative integer m such that m ^ x, 
for all x G K. Consider the following simple lemma. 

Lemma 8. Let v G V(Qs) be a vertex of weight w. Then the 
degree of v in Qs is given by 



deg(u) 



d' 

E 



min{u?,2} 

E 

_r«.+«-d'i + 



n — w 
i-j 



- 1 



Proof. Let u£V(Qs) be a vertex of Qs distinct from v, 
and suppose that wt(u) = i for some i G {1, 2, . . . , d'}. Then 
d{u, v) = wt(it) + wt(t;) — 2|x(u) n where %(•) denotes 

the support of a vector in F 2 ". Write j = \x( u ) ^ x( w )l- Then 
clearly j ^ minjui, i}. Furthermore, u and v are adjacent in Qs 
if and only if d(u, v) = w + i — 2j ' ^ d' . It follows that 



min{u> ,i} 

E 



J 



(20) 



is the number of vertices of weight i that are adjacent to v, for all 
i ^ w. For i = w, we need to subtract 1 from the sum in i2Q\ . 
because the sum counts v itself. | 



Proposition 9. 




d' min{u;,i} 

E E 

i=i i=r^r 



W \ j n—w 



Proof. Since Qs has (™) vertices of weight w, this follows 
immediately from Lemma|8| | 

Comparing the foregoing expression for e(Qs) with the ex- 
pression for e(n, d) in Theorem^ we see that e(n, d~ 1) is equal 
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to e(Qs)/3- Thus Proposition|9]in conjunction with Theorem[7] 
establish 0. This completes the proof of Theorem^ 

Although Proposition|9] gives an exact expression for e(Qs), 
the asymptotic form of this expression is not immediately clear. 
Thus we now turn to asymptotic bounds on e(Qg). Observe that 
^(fc)| = V(n, d') — 1, so that a complete graph on V(Qs) has 
Q,{V(n, d') 2 ) edges. In contrast, we will show that under certain 
conditions, there is ane > such that e(G$) = o(V(n,d') 2 ~ £ ). 
To this end, the following lemma will be useful. 

Lemma 10. Let u and v be vertices in V(Gs) an d suppose that 
wt(v) ^ wt(u). Then deg(w) > deg(w). 

Proof. It would suffice to prove that for all w £ {2, 3, . . . , d'}, 
we have deg(w) ^ deg(it) if wt(u) = w and wt(u) = w — 1. 
Moreover, by Lemma[8]the degree of a vertex u in Qs depends 
on u only through its Hamming weight wt(u). Thus we can 
assume without loss of generality that 

X(u) = {1,2,..., w} and x( v ) = { 2 , 3, . . . , w} 

Now consider N(u) and N(v), the neighborhoods of u and v 
in Qg. It is easy to see that 

N(u)-N(v) = {xeV{G s ) : d{u, x) = d! and x x = 1 } 

N(v)-N(u) = {xeV{G s ) : d(v, x) = d' and x x = } 

where x% denotes the first bit of the vector x = (x\, Xi, . . . , x n ) 
in V(Gs). Let us denote the sets N(u)-N(v) and N(v) -N(u) 
by A and £>, respectively. Let ip : F 2 " — > F 2 ™ be the mapping 

^(x) = .t + (100---0) 

Note that (p(u) = v and <p(v) = u. We claim that <p(A) C £>. 
Indeed, let us write </?(x) = y = (y%, y 2 , . . . , y„). Evidently, if 
d(u, x) = d! and x\ = 1, then d(v, y) — d! and y\ = 0. More- 
over, for all x <E F 2 ™ with x% = 1, the weight of p(x) iswt(x) — 1. 
Thus if x e A then (p(x) € V{Gs) unless x = (100 • • • 0). How- 
ever (100 ■ ■ - 0) ^ A, since the distance between (100 • ■ • 0) and 
u is given by w — 1 ^ d' — 1 < d'. This proves that <p(A) C £>. 
Since 95 is a bijection on F 2 ™, the fact that y>(.4) C B implies that 
\A\ < \B\. Hence iV(v) ^ |AT(zt)|, and the lemma follows. | 

The rest of our asymptotic analysis involves the binary en- 
tropy function defined by 

H2(x) = — xlog 2 x — (1 — x) log 2 (l — x) 

for all ^ x ^ 1. In particular, we will make frequent use of 
the following lemma 1 3 1 pp. 308-310], which is a well-known 
estimate for a sum of binomial coefficients. 

Lemma 11. Let p, S K, and suppose that pn is an integer in the 
range 1 $J an 0.5n. Then 



2nH 2 (iJ.) 

y/8np(l-p) 



E 

fe=0 



(21) 



Now, let A be a real number in the range 2 / 3 $C A < 1. To sim- 
plify notation, we henceforth assume that d! < 0.5n and that Xd' 
is an integer (this obviates the need for numerous ["•] and |_-J 



functions in what follows). We will derive a bound on e(Qs) by 
considering separately vertices of weight < Xd' and vertices of 
weight ^ Xd' in Q$ . Thus we write 

• i;, s j + if W = ei(A '"' li) t '^•"•V ,22, 



^e(I) 

8 = 1 V 7 



with 



;i(A,n,d) - £ (deg(«) + l 

«ev(s s ) 

wt(w)<Ad ; 

Ad'— 1 / \ d! min{w,i} 

= E : E E """ " " 

it>=l ^ 7 i=l . r. 

e 2 (A,n,rf) d = (deg(u) + 1 

«6V(S S ) 
d' , v d' mi 

E IE E 



s w/ — ' ' — ' V 7 / \ * — 7 



«6V(S S ) 

wt(ii)^Ad' 

d' / s d' min{tu,i} 

n\v—v \ ^ iw\ln—w 



(23) 



w =\d' x 7 f=l 3 ._r m+i -d' j + 



(24) 



where the explicit expressions for ei(A, n, d) and e 2 (A, n, d) 
follow from Lemma|8] and Proposition|9] Let v be a vertex in 
V(G S ) with wt(v) = 1. Note that \(l + i- d') /2] + = for all 
i ^ ci' — 1. Therefore, by Lemma|8j we have 




where S = d'/n and the last inequality follows from LemmafTTl 
Combining the definition of ei(A, n, d) in d23i with LemmafTo! 
thus produces the following bound 



Ad'-l 



ei (X,n,d) < 2 nH ^ (l) < 2"( ff2 ^ +ff2 ^) (25) 

Now, let w be a vertex in V{Gs) with wt(u) = Ac?'. Then, again 
by Lemma|8] the degree of v in Qs is given by 



deg(v) + 1 = hi(X,n, d) + h 2 (X,n,d) 



with 



hi(X,n,d) = EE 



i=i 3=0 

w — l 



w\f n—w 



jjv-j 



(26) 



h 2 (X,n,d) d ^ J2 E 



i—^id' + l ■ \ i—j±dJ 

J—\ 2 



d w 



w \ I n—w 



J J V - 3 



w\ n—w 



- ^IsKi-V ,:7! 



where we have introduced the notation w — Xd' and p = 1 — A. 
To upper-bound hi(X, n, d), observe that for all i and j in the 
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double-sum we have j ^ i ^ ad' ^ 0.5w and therefore 

O0<(7)- Thus 



.,(a,mxe(i)e(;:™) 



^ 2 nA5H 2 (f) + n(l-A4)H 2 ( T ^ r ) (2g) 

To upper-bound h 2 (X,n,d) in ( I27> . we will use the trivial es- 
timate (™) «C 2 W = 2 nXS for all j (in the case of this 
estimate is actually not too far off). Thus 



h 2 (X,n,d) < 2" A5 £ E 



n—w 



+ 2 " A5 E E 



n—w 



(29) 



Since the summation on j in the second double-sum of J29l > is 
up to w ^ i, we can proceed with the upper bound by uniting 
the two double-sums as follows 



h 2 (X,n,d) ^ 2 nX5 Y, E 



hMd' I 



n—w 



2" A5 E E 

z— ^d' + l j— 



n—w 
3 



(30) 



where the equality in J30I follows by a straightforward change 

A 
2' 



of variables. Finally, observing that (i + /id')/2 ^ d' — ^d' for 



all i ^ d', we get 

d' L d '-# d 'J 



i— /id' + l J — 



nA5 + n(l-A5)ff 2 , ?. 

nA<5 2 V *=™J (31) 



Combining (12 8b and yTJ with the definition of e 2 (X,n,d) 
in J24i and once again invoking LemmalTol we obtain the fol- 
lowing bound 



e 2 (X,n,d) < (deg(«) + l) ]T j W 

w=\d' ^ ' 

^(h 1 (\,n,d) + h 2 (\,n,d)^J2( n ) < 33 ) 

w=0 ^ 

„( ff2 (5)+A5H 2 (f)+(l-A5)K 2 ( T ^ 7 ) 
^ 2 V / 

+ n\52 V / (34) 



n ff 2 (5) + Ai+(l-A5)H 2 (i T ^)l 

(nX5 +1)2 V / (35) 



where d35l follows from the fact that for 2 / 3 < A < 1 and 5 ^ 0.5, 
the first exponent in fl34i is strictly less than the second expo- 
nent. We are now ready to prove the following proposition. 

Proposition 12. Let e and X be positive real numbers strictly 
less than 1, with X ^ 2 / 3 . Then e{Qs) — o(V(n, d') 2_£ ), pro- 
viding 5 — d! In satisfies the following two conditions: 



{l-e)H 2 {8) > H 2 (X5) 



(36) 



(l-e)H 2 (5) > X5 + (1-AS) ifr ^J^ 2 ) (37) 

Proof. We estimate e(Gs) by combining fl22i with the upper 
bounds in d25i and d35i on ei(A, n, d) and e 2 (X, n, d). It follows 
that the ratio e(Gs)/V(n, d') 2 ~ e is upper-bounded by 



yi(H 2 (XS) - (l-e)ff 2 (5)) 



V{n,d'f- (SnSil-S))^ 1 

(nXS + 1) 2 n ( XS + ( 1 - A<5 ) ff2 ( £ r^) - MftW) 

+ (8n<5(l-(3)) f_1 

where we used LemmafTTI to bound V(n, d'). It is clear that 
if S satisfies (1361 - l l37l . then the right-hand side of the above 
expression tends to zero (exponentially fast) as n — > oo. | 

Motivated by Proposition^] we now introduce the functions 
f e ,\(3) and g £ ,\(3) with domain 5 £ [0, 0.5], parametrized by e 
and A and defined as follows 

f s ,x(S) d = (l-e)H 2 (6) - H 2 (XS) 

g s , x (S) d = f (ls)H 2 (S) - XS - (l-XS)H 2 (^^j 

The two functions f £ ,\(S) and g e ,\(5) are plotted in Figure 1 and 
Figure 2, respectively, for e = 0.000001 and A = 0.999. Fig- 
ure 3 shows a close-up view of these two functions (for the same 
e and A) in the range 8 € [0.499, 0.5]. It can be seen from Fig- 
ures 1 , 2, and 3 that conditions d36l > and d37i of Proposition! 121 
are satisfied whenever d! jn ^ 0.4994. 

We are now ready to complete the proof of Theorem|2] By 
Lemma|3] A 2 (n,d) — a(Qo), where Qq is the Gilbert graph 
defined in SectionllTll The Gilbert graph is a A-regular graph on 
|y(t/ G )| = 2" vertices with constant degree A = V(n, d') — 1. 
The subgraph of Qq induced by the neighborhood of any vertex 
in V(Gg) is isomorphic to the sphere graph Qs and has exactly 
e{Qs) edges. Therefore, by TheorerrQ for all e > 0, we have 



A 2 (n,d) > 



2" log 2 V(n,d') -V 2 log 2 e(G s ) 



V{n,d') 



10 



2" fe\og 2 V(n,d') 



V{n,d') 



20 

log 2 V(n,d') 2 -c 



log 2 e(£ 5 ) 



20 

By Proposition! 121 the ratio e(Qs)/V{n, d') 2_£ tends to zero for 
e = 0.000001, whenever d'/n < d/n < 0.4994 (cf. Figure 3). 
Therefore, the second fraction in parentheses becomes positive 
for all sufficiently large n, and Theorem|2follows. 
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Figure 1. Plot of the function f St \(5) fore = 0.000001 and A = 0.999 



0.1 




0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 



Figure 2. Plot of the function g £ ,\(5) fore = 0.000001 and A = 0.999 



0.8 - 
0.6 - 
0.4 - 

0.2 - 




0.499 0.4991 0.4999 0.4993 0.4994 0.4995 0.4996 0.4997 0.4998 0.4999 0.5 

Figure 3. Close-up view of the functions f £ ,\(S) and g £ ,\(8) in the 
neighborhood of <5 = 0.5 fore = 0.000001 and A = 0.999 

Remark. We note that the degree of a vertex v in Qs is related 
to the so-called intersection numbers p™ k of the Hamming as- 
sociation scheme Tt(n,2) — see |13| and 1 3 1 , Chapter21] for 
a detailed description of TC(n, 2). Specifically, given any two 
vectors u,!i£ F 2 " with d(u, v) = w, the intersection number pf k 
is defined as the number of vectors x 6 F 2 ™ such that d(x, u) = i 
and d(x 1 v) = k. Thus the sum J20i can be written as 

+ •■■+?<> 

An explicit expression for p™ k is given in 1 3 1 p. 656] . However, 
the proof of Lemma[8]above, which does not use the intersection 
numbers, appears to be simpler and shorter. 



Remark. To get the best threshold on d/n such that (0 holds, 
one should optimize the value of A for a given e in Proposi- 
tionl 1 2\( alternatively, one could try to directly find the maximum 
term in the triple-sum of Proposition^. We have made no spe- 
cial effort to optimize this threshold beyond 0.499. However, we 
believe that with an appropriate choice of e, A in Pi'opositionll2l 
(or with other methods), one can get as close as desired to the 
ultimate threshold d/n ^ 0.5. It is, therefore, surprising that for 
6 = 0.5, the number of edges in Qs is very close to V(n, d') 2 . 

Proposition 13. Ifd'/n = 0.5, then e(Q s ) ^ 0.25F(n, d') 2 . 

Proof. Let v £ V(Qs) be a vertex of weight d' = n/2, and 
let 1 denote the all-one vector (11 • • ■ 1) in F 2 " . Then 1 + v is 
another vertex of weight d 1 in V(Qs). Given any other vertex 
u G V(Qs), we have d(u, v) + d(u, 1+v) = n = 2d', so that u 
is adjacent to at least one of v or 1 + v. Thus every vertex in Qs 
is adjacent to at least half of the vertices of weight d! (excluding, 
possibly, itself). This implies that 

e \t (:)(;) <*> 

"ev-(s s ) \ / \ / 

wt(ii)=d / 

By Lemma|8] all the vertices of weight d! have the same degree 
in Qs- Thherefore, it follows from d38> that for every v £ V(Qs) 
with wt(v) = d', we have 

deg(,) +1>\£(1) (39) 

w — 1 ^ ' 

Now, by LemmaflOl the degree of all other vertices in Qs is 
greater or equal to the degree of a vertex of weight d' . This 
essentially establishes the proposition. It remains to worry about 
the fact that the sum on the right-hand side of d39l does not 
include the term (™) and about the extra 1 on the left-hand side 
of ( 1391 . We omit these tedious details. | 

Thus it appears that the sphere graph Qs transitions abruptly 
from being sparse to being nearly complete at d! jn = 0.5. We 
do not have an intuitive "explanation" for this phenomenon, but 
note that it is reminiscent of threshold phenomena for codes and 
graphs observed in |47| and in 1 33 1, respectively. 

We also note that for d/n ^ 0.5, the problem of determin- 
ing A2(n, d) is essentially settled. Provided enough Hadamard 
matrices exist, A 2 (2d, d) = 4d and A 2 (n, d) = 2 \ d/{2d - n)\ 
for all even d with 2d > n. This is the well-known result of 
Levenshtein |28|, who constructed codes achieving the Plotkin 
bound 1 3 1 pp. 41^-3] from Hadamard matrices. 

V. Generalizations and Open Problems 

The well-known proofs by Gilbert 1 18 1 and Varshamov 1421 of 
the bounds in (|2j and (|8j, respectively, are "constructive" in that 
they provide simple (but exponential-time) algorithms to con- 
struct codes whose parameters meet or exceed the corresponding 
bounds. Moreover, Gilbert's "constructive" argument |18| has 
been extended to quite general contexts |20 1, 1 38 1, |46 1 using the 
so-called altruistic algorithm (which is also exponential-time). 

We would like to point out that the bound of Theorem|2] is 
"constructive" in the same sense as 1201 . (38 1, |42|, and |46|. 
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Hofmeister and Lefmann |22| provide an algorithm which, 
given any A-regular graph G with at most n(G) A 2_e triangles, 
finds an independent set of size at least £l(n(G) log 2 (A)/A) 
in G. By the results of Section IV, the Gilbert graph Qq con- 
tains at most 0(ti(Qg) A 2 ~ e ) triangles whenever d/n ^ 0.499. 
Thus, when applied to the Gilbert graph Qq, the Hofmeister- 
Lefmann algorithm |22| will produce codes satisfying Q. The 
Hofmeister-Lefmann algorithm runs in time that is polynomial 
in the size of Qq but, of course, exponential in the code length n. 

Up to now, for the sake of brevity, we have focused exclu- 
sively on binary codes. Nevertheless, it should be clear that 
Theorems ^ an d ID can be generalized to arbitrary alphabets of 
size q, where q need not even be a prime power. Here, we give 
a generalization to q-ary alphabets of Theorem^ 

Theorem 14. Let q, n, and d be positive integers with d ^ n and 
q 2. Define the volume of a q-ary Hamming sphere of radius d 

asV q (n,d)=Y,Lo ("K?- 1 )*. and let 



1 d d a a—j 



(q-2) k (q-l) w+i 



6 ' ^^-^ -^-^ j| k\ (w— c)\ (i—c)\ (n+c—w—i)l 

w—li—lj—lk—b \ / \ / \ / 



V q (n,d) 



cent in Q q _g to a fixed vertex v G V(Q q ,s) of weight wt(w) = w 



as follows 



EE 

j=0 k=b 



where a, b, and c are as defined in the theorem. For i = w, we 
again need to subtract 1 from the sum in (14- 1 i since the sum then 
counts v itself. Enumerating over all possible values of i, we 
find that the degree of v in Q q $ is given by 



d' a a—j 

EEE 

i=l j=0 k=b 



W-J 

k 



(q-2) k (q-lY 



(42) 

The total number of vertices of weight w in Q q .s is (™) (q—l) w . 
Combining this with (1421 produces an expression for e(Q q ,s), 
and it is easy to see that e q (n, d—1) = e(Q q> s)/3- | 

Remark. We could have used the intersection numbers pV. of 
the Hamming association scheme TC(n, q) in the proof of The- 
oremll4l Specifically, the sum in ( 14 li can again be written as 

Pi,o+Pi,i + ---+Pi,d>- Therefore 



where a = f min{?i;, i}, c = f j+k, and b is the smallest nonnega- 
tive integer that is greater or equal to (w+i)— j— xmn{d+j, n}. 
Then 

log 2 V q (n,d-l) - log 2V /e g (n,d-l) 



A q (n,d) 



V q (n,d-l) 
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(40) 



Proof. Let A be an alphabet with q letters. We define the 
g-ary Gilbert graph Q q ,Q as before, namely V(Q q _o) — A n and 
{u,v} £ E(Q q Q) if and only if 1 ^ d(u,v) ^ d! . Then Q q ^Q 
is A-regular with A = V q (n, d') — 1, and TheorerrQ applies. 
It remains to count the number of edges in the graphs induced 
in Qq.G by the neighborhoods of its vertices. Without loss of 
generality, we can call any one of the letters of A "zero," and 
consider the graph Q q t s which is induced in the q-ary Gilbert 
graph by the neighborhood A^O) of the vertex 6 A n . 

Let u — (u\, «2, . • • , u n ) and v = (vi, ■ ■ ■ , v n ) be two ver- 
tices of Q q ^s with wt(u) = w and wt(w) = i (observe that Ham- 
ming weight is well-defined, once we have identified a G A). 
Let 

j = \{l : ui = vi,v t ^ 0, ui ^ 0}| 
k d = \{l : ui ^ vi, vi ^ 0, ui ^ 0}| 

It is obvious that j ^ min{w, i}. Further, if j is already fixed, 
then clearly k ^ min{w, i} — j. Moreover, w — k — j is the 
number of positions / such that vi ^ and ui = 0. This number 
cannot be greater than n — wt(u) = n — i, which implies that 
k ^ (w+i) — j — n. Finally, it is easy to see that 



d(u, v) 



w - 



2j 



so that the vertices u and v are adjacent in Q q ^ if and only if 
k ^ (w+i)—j—(d'+j). Putting all this together, we can enume- 
rate the total number of vertices of weight i ^ w that are adja- 



e(Gq,s) 



1 



d' d' d' 



2 EEE 

W — 1 2—1 j—1 



with the convention that pfj = Owhenw > i+j. A formula for 
the intersection numbers of the q-ary Hamming scheme H(n, q) 
may be found in [5 eq. (2)]. While the resulting expression for 
e q (n 7 d) is shorter than its counterpart in TheoremfT4l we prefer 
the latter since it is more explicit. 

In the original version of this paper, we have left the asymp- 
totic investigation of the bound in Theoremfl4las an open prob- 
lem, and conjectured that it should lead to 



A q (n,d) ^ c 



V q (n,d-1) 



log 2 Vq(n,d-l) 



(43) 



for some positive constant c. This conjecture has been proved in 
the recent work of Vu and Wu 1 43 1 . Specifically, Vu and Wu 1 43 1 
show that if d/n < (q~l)/q, then (I43> holds for a constant c 
that depends on the ratio d/n. They also give an explicit, though 
rather elaborate, expression for c in terms of d/n. 

Our general approach can be extended to many other situa- 
tions where generalizations of the Gilbert- Varshamov bound are 
currently used. We give just one concrete example. 

Let A(n, 2d, w) denote the the maximum number of code- 
words in a binary code of length n, constant weight w, and 
minimum Hamming distance 2d. Levenshtein 1 29 1 has general- 
ized the Gilbert bound (0 to constant-weight codes. It is shown 
in (29) that 



A{n,2d,w) ^ 



|F 2 (n,«;)| 
V(n, d—1, w) 



(44) 



i=0 



w\ I n—w 

i , 
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where ¥2(12, w) is the set of binary vectors of length n and 
weight w and V(n, d, w) is the volume of a sphere of radius d 
in the Johnson metric. Using the same approach as in Theorems 
□andd we can improve upon the bound in (1441 as follows. 

Theorem 15. Let n, d, andw be three positive integers such that 
d w ^ n/2. For positive integers i, j, k, all less than or equal 
to w, define p\ ^ as follows 



k dd / n-w-k\ ( k \ / k 
''' J ^ I I )\i I 

for all k ^ i + j, where 



(45) 



dct 



b = min{i, j,i + j — k,n — w — k} 
Set p^ j — for k > i + j, and define the following quantity 

d d d 



max{0, i — k, j — k,i + j — w} 



e(n,d,w) d ^ gSS2v A- 

i=l j=l k=l 



w \ I n—w 



(46) 



Then 



A(n,2d,w) ^ 



|F 2 (n,w)| 
V(n, d—1, w) 

log 2 V(n,d-l,w) - log 2y /e(n,d-l,w) 
10 



Proof. The underlying "Gilbert graph" Q can be defined as 
follows: V{Q) = ¥ 2 (n,w) and {u,v}eE(Q) if and only if 
2 ^ d(u, v) ^ 2d' . Now fix a vertex z S V(Q) and consider the 
graph Qs that is induced in Q by the neighborhood N (z). Clear- 
ly, all such graphs are isomorphic. The numbers p\ j in ( 145 \ are 
precisely the intersection numbers of the Johnson association 
scheme 1 3 1 p. 665]. It follows that if v is a vertex of Qs such 
that d(z, v) = 2k, then the degree of v in Qs is given by 



d' d' 



deg(v) = 



ft-, 



i=lj=l 

Hence e(Gs) — 3e(n, d— 1, w), where e(n, d, w) is the quantity 
defined in ( I46> . The desired bound on A(n, 2d, w) now follows, 
as before, from Theorem^] | 

We leave the asymptotic analysis of TheoremfT5l as an open 
problem for future research. 

In the original version of this paper, we have also suggested 
the following problem: generalize the results of Theoremnand 
Theorem|2]to lattices and sphere-packings, where the counter- 
part of the Gilbert- Varshamov bound is the Minkowski-Hlawka 
theorem |12|, |30|. This problem was recently solved in |27|. 
Specifically, Krivelevich, Litsyn, and Vardy 1 27 1 show that us- 
ing graph-theoretic methods similar to those of Section EH, the 
classical Minkowski bound 1 34 1 on the density of sphere pack- 
ings in R™ can be also improved by a factor that is linear in n. 

Other interesting problems for future work would be the ex- 
tension of Theorems^andlJlto spherical codes |44|, to covering 



codes ifTTl Section 12.1], to codes correcting arbitrary error pat- 
terns 1 30 1, to runlength-limited codes |24|, and to more general 
constrained systems |32|. The general approach introduced in 
this paper should work whenever an underlying "Gilbert graph" 
can be defined, and happens to be locally sparse. 

Our results herein have applications outside of coding theory 
as well. For example, the following problem arises in the study 
of scalability of optical networks 1 36j . Let Ti n be the Tridimen- 
sional hypercube, defined in Section III. What is the minimum 
number Xd(n) of colors needed to color the vertices of 7i n so 
that vertices at distance ^ d from each other have different col- 
ors? Ngo, Du, and Graham |35| have recently established the 
following bound 



Xd(n) 2 L 1 °s^("- 1 - d - 1 )J+ 1 
2 



2 {log 2 V(n-l,rf-l)} 



V(n-l,d-l) 



(47) 



In fact, this follows immediately from the Varshamov bound (|8}, 
since given any linear binary code C, assigning different col- 
ors to the cosets of C in F 2 ™ produces a valid coloring. While 
Theorems n an d|21 improve upon (|8j, unfortunately, we do not 
know whether there exist linear codes that attain (|3} and/or (|5}- 
Nevertheless, we can still improve upon ( I47> . as follows: if 
d/n ^ 0.499, then there exists a positive constant c such that 



Xd(n) ^ c 



V(n, d) 
\og 2 V(n, d) 



(48) 



This uses a result of Alon, Krivelevich, and Sudakov |2|, who 
show that locally sparse graphs with maximum degree A can be 
colored using 0( A/ log A) colors. Specifically, let G be a graph 
with maximum degree A such that the number of edges in the 
subgraphs induced in G by the neighborhood of any vertex is 
at most A 2 //. Then it is proved in J2j Theorem 1.1] that the 
chromatic number x(G) of G satisfies x{G) ^ c\ A/ log 2 / for 
some positive constant c%. Since the Gilbert graph Qq, defined 
in Section III, is 7i n to the power (d — 1), it should be clear that 
Xd-i{n) = x{Sg)- The Gilbert graph Qq has maximum degree 
A = V(n, d—l) — 1. Moreover, we have shown in the previ- 
ous section that this graph is locally sparse: if Qs is the graph 
induced in Qq by the neighborhood of any vertex v 6 V(Qq), 
then e(Q s ) «S c 2 A 2 /V(n, d~l) e for e = 0.000001 and some 
positive constant c 2 , provided d/n ^ 0.499. Combining this 
with 1 2 Theorem 1.1] establishes ( I48> . 

Finally, we would like to point out some questions concerning 
Theorems[2and|2]that remain open. Our proof of these theorems 
gives no hint of linearity. Nevertheless, we ask: are there linear 
codes whose parameters satisfy 0? It is conceivable that a suit- 
able modification of the Varshamov 1 42 1 argument for construct- 
ing a parity-check matrix could produce such codes. It is well 
known that a random (linear) code meets the Gilbert- Varshamov 
bound with probability approaching 1 as n — > 00. Thus we ask: 
do random codes also meet the improved version of this bound 
in Theorem|2J , Progress on this question was recently reported 
by Cohen 1 10 1. Of course, the most interesting question of all is 
whether the term log n in @ can be further improved to a linear 
term. In other words, it it true that the Gilbert- Varshamov bound 
on the rate of binary codes is asymptotically exact? 
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